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SMALL NOISE ASYMPTOTICS FOR INVARIANT 

DENSITIES FOR A CLASS OF DIFFUSIONS: 
A CONTROL THEORETIC VIEW 
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Abstract: We consider multidimensional nondegenerate diffusions with in- 
variant densities, with the diffusion matrix scaled by a small e > 0. The 
o.d.e. limit corresponding to e = is assumed to have the origin as its 
unique globally asymptotically stable equilibrium. Using control theoretic 
methods, we show that in the e 1 limit, the invariant density has the 
form w exp(—W(x)/e 2 ), where the W is characterized as the optimal cost 
of a deterministic control problem. This generalizes an earlier work of Sheu. 
Extension to multiple equilibria is also given. 
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1 Introduction 

A recurrent theme in applied mathematics is the resolution of non-uniqueness 
issue of a deterministic system by considering its perturbation with small 
noise and recovering a hopefully unique choice by passing to the vanishing 
noise limit. (This idea is attributed to Kolmogorov in [7], p. 626) To mention 
two such instances, see the analysis of jump phenomena in nonlinear circuits 
in [20] and equilibrium selection in evolutionary games in [TUj. In fact the 
notion of 'viscosity solutions' we use later in this work can be motivated 
along these lines. 
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A similar situation also arises in the passage from quantum to classical 
mechanics (the correspondence principle) when one uses the Feynman-Kac 
device to convert Feynman path integrals to Wiener space integrals by com- 
plexifying time, whence the problem reduces to that of small noise behavior 
of diffusions. Motivated by this, Freidlin and Wentzell have extensively de- 
veloped the small noise limit theory for diffusions 



Building on the classic work of Freidlin and Wentzell [TTJ, Sheu in 
characterized the small noise limit of the invariant density of a positive recur 
rent diffusion for a restricted class of diffusions. This was further extended 
by Day [6]. Our aim is to establish a similar result in a more general set- 
up, using a novel control theoretic approach based on the theory of viscosity 
solutions. We do so by exploiting the fact that the 'adjoint' partial differential 
equation satisfied by the invariant density gets converted to the Hamilton- 
Jacobi-Bellman equation of an associated ergodic control problem via the 
logarithmic transformation. The limiting case thereof as the noise decreases 
to zero can then be handled by exploiting the machinery of viscosity solutions. 

The paper is organized as follows: The next section introduces the prob- 
lem and states the main result. Section 3 uses the equivalent control for- 
mulation in order to go to the small noise limit and obtain the asymptotic 
expression for the invariant density as ~ exp(—W(x)/e 2 ). Section 4 obtains 
a representation for W in terms of a deterministic control problem. Section 
5 extends the results to the case of multiple equilibria. 

See also [I], 0, US], [23] for related work. 

2 The small noise asymptotics 

We consider an d- dimensional diffusion X given by the stochastic differential 
equation 

dX(t) = b(X(t))dt + ecr{X(t))dB(t), t > 0, (1) 

where b : M. d — > W 1 , a : R. d — > ~$l dxm are smooth, bounded, with bounded 
derivatives, and B is an m-dimensional Brownian motion. We assume: 

1. ||-D K 6(a;)||, ||.D K cr(a;)|| < C < oo for some C and all x and all multi- 
indices K. 

2. a(x) = [[a,ij(x)]\ = a(x)a T (x) satisfies: 

X\\x\\ 2 < x T a(y)x < A\\x\\ 2 , \/x,y e R d , 



for some < A < A. 
3. There exist constants a > 0,0 < ft < 1 such that 



lim sup 



\\x — >oo "- 



aA+\\x\\ 1 -%(x) T { 1 ^)\<0. (2) 



4. 6(0) = and zero is the unique globally asymptotically stable equilib- 
rium point of the o.d.e 

x(t) = b(x(t)). (3) 

Let 

£ e ^ <&(•), V) + ^tr(a(.)V 2 ) 

Theorem 1 : For each e G (0, 1), X(-) is positive recurrent and the corre- 
sponding (unique) stationary distributions {fi e ,0 < e < 1} are tight. Fur- 
thermore, lim^o// = 8 , where S x for x G M. d is the Dirac measure at x. 

Proof: For V(x) = ||x|| 2 , direct computation shows that 
CV{x) = e 2 ^au{x) + 2b{x) T x 

i 

< de 2 A + 2b{x) T x 

< de 2 A-aA\\x\\ $ (4) 

for ||x|| > a sufficiently large K > 0. (The last inequality follows by virtue 
of 02]).) In particular, 

CV{x) < -5 

for some 5 > and sufficiently large ||ar||. But this is the standard stochastic 
Liapunov condition for positive recurrence of nondegenerate diffusions, im- 
plying in particular the existence of /i e . To see this, first note that a simple 
application of Dynkin formula in conjunction to the above leads to the con- 
clusion that the mean hitting time of {x : \\x\\ < K} from any point is finite 
(p. 305, [13]). An invariant probability measure can then be constructed as 
in [16] (see also [E]). Uniqueness follows from the observation that under 
the stated hypotheses, X(t) has a density p(y\x, t) > for all t and therefore 
so does /i e (<ix) = fp(x\t, z)n e (dz). Thus any two invariant measures would 
have to be mutually absolutely continuous. But by a well known fact from 
ergodic theory of Markov processes (section XIII. 4, [213), two distinct ex- 
tremal invariant probability measures of a Markov process must be mutually 



singular. This contradiction implies that the invariant probability measure 
is unique. Also, by Proposition 2.3 of [TS], we have 



\C e V\d^ < K < oo (5) 

for some K. By Theorem 9.17 of [8], /z e is characterized by 

C e fdfi € = (6) 



for twice continuously differentiate / with bounded first and second deriva- 
tives. 

From (J4]), C e V(x) < —g(x) for a g satisfying lim g(x) = oo. Thus for a 

||a;||— >oo 

suitable K* > 0, C e V(x) < for ||x|| > K*. Using ([5]), we then have 
f g(x)dfi e < f \C e V\dfi e <K. 

J\\x\\>K* J\\x\\<K* 

Since lim g(x) = oo, this implies tightness of {//, e > 0}. Now let e ^ in 

||a;||— >oo 

(JHJ) to obtain 

/ C°fdfx = 

for all / as above and all limit points \x in V(M, d ) of fi e as e l 0. By the criterion 
dSl), A 4 m ust be an invariant measure for ([3]). But under our assumptions on 
dSj), this is possible only for /j, = So- □ 

Our aim is to capture the precise manner in which fi e — > 5 . Note that 
for e > 0, fi e will have a density (p e . First we will prove the following result 

Theorem 2 : lim^o e 2 \n(ip £ (x)) = —W(x) for 

W(x) = f inf f / u(t) T aT\y(t))u(t)dt\ , (7) 

where the infimum is over all measurable «(•) such that the trajectory y(-) 
of 



y{t) = -b{y{t))-u{t), y(0)=x, 



satisfies: y(t) —¥ 0. 



We prove this in the subsequent sections. 



3 The control formulation 

As observed above 

fc e fdfi e = J £ € f(x)(p e (x)dx = (9) 

for smooth compactly supported /. Hence ip e satisfies 



e 2 



or equivalently, 



2 E wU + E ^ + c ^ e = °> ( 10 ) 



1 n n b e c e 

2 E wU- + E #< + ^ e = o, (f f ; 



where, 



Define 



6- = -6j H-e 2 E(°*J')x J -, for i = 1,2, ••• ,n, 
i=i 

2 n n 

i,j=l i=l 



A e = / i-tr(aV 2 ) + (6 e ,V). 



Letting W^(x) = — e 2 ln(y9 e (x)), W e is seen to satisfy 

A e W € (x) - ]-DW\x) T a(x)DW e {x) - e 2 c e (x) = 0, (12) 

or, equivalently, 

V a^W* .. + min (fr e - u) T M e + 



— V a i7 -W.f T + min f(6 e - u) T DW e + -u T a _1 w - e 2 c e (x)] = 0. (13) 
2^ J x * x > urn* V ' 2 v J \ K ' 

Observe that this is the HJB equation for a certain ergodic control problem. 

Lemm; 

C(R d ). 



— def 

Lemma 1: W e (-) = W e (-) - W e (0),e G (0,1), is relatively compact in 



Proof: In view of (fTUj) and the Harnack estimates of Theorem 5.2 of 
we have 



\DW £ (x) 



\DW e (x)\\ <CWxe 



(14) 



for a constant C depending only on A, ||a||c 4 (R d )> 
the claim follows by the Arzela-Ascoli theorem. 



\ c2(Kd) . Since W e {0) = 0, 



□ 



Now note that the minimum over u in (1131) is attained at u — a(x)DW e (x), 
which is bounded by (fUj) . Thus without loss of generality, for purposes of 
analysis we may a priori restrict this minimization to a closed bounded set I\ 
Now letting e 4- 0, standard arguments from the theory of viscosity solutions 
([3], Prop. VI. 1) tell us that along an appropriate subsequence, W e —¥ W 
uniformly on compacts, where W is a viscosity solution to the p.d.e. 



mm 



[-b(x) - u) 1 DW + -u 1 cC v u 



0. (15) 

In view of (TT4|) . W is in fact Lipschitz. For the deterministic control system 



x 



define 



W(x,t)= inf 

x(0)=x 



L2 



-b{x) — u(t), 



u(sY a- 1 (x(s))u(s)ds + W(x(t)) 



(16) 



where the infimum is over all measurable and locally square-integrable «(•). 
Since W is Lipschitz, W will be a Lipschitz continuous viscosity solution [3] 
of 



W t (x,t) 



inf 



f -b(x) - u) T DW(x, t) + -u T a _1 (a;)w 
0<t<T, W(x,0) = W(x). 



From Theorem VI. 1 of jl], it follows that this equation has a unique viscosity 
solution and thus W = W. That is, W is a stationary solution to the above 
p.d.e, which is also its unique viscosity solution. In particular, W satisfies: 



W(x) 



inf 

x(o)=x L2 



u(s) 1 a~ L (x(s))u(s)ds + W(x(t)) 



;i7) 



where the infimum is over all (x(-),u(-)) satisfying (fT6l) with u(-) locally 
square-integrable. We use this to establish several additional properties of 
W in the next section, leading to our main result. 



4 Proof of Theorem 2 

We proceed through a sequence of lemmas. 

Lemma 2: W(x) > 0. 

Proof: Suppose W e " — > W uniformly on compacts and suppose there exists 
x 7^ such that W(x ) = —5 for some 5 > 0. Let B r (x) denote the open 
ball of radius r centered at x. Then for a sufficiently small r, we have 

A A 

W 6n (x) < -- for re e B r (x ); W en (x) > -- for x G 5 r (0). 

So for n sufficiently large, 

//"(£ r (0)) _ J Br (o)^ n ^ dx 
fj^(B r (x )) 



J D r 


M <? 


: "(x)o 


!x 


JB 


,(o) e 


W €n (x) 


da; 


J B r 


(so) 


VK e n( x 
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) 
da; 


JB 


r (o) e 


W En (x) 


da; 


J J3 r 


(so) 




) 
da; 


\B 


r(0)|e 


J^T 


v n 



< j > as n f oo. 

This contradicts Theorem 1, proving the claim. □ 

Lemma 3: For {e n } as above, lim^^ W €n (0) = 0. 
Proof: We may write 

W(x) 

^(x) = v? £n (0)/i £n (a;)e ~^~ 

where e 2 l \n(h €n (x)) — > uniformly on compact sets. Let A C M. d denote a 
compact set with in its interior. Then 

e 2 n \n( / y? e "(a;)da;J = e 2 n \n( / (p en (0)h en (x)e ^~dx 

We have 

t 

n -4° ess.sup{e _w/(:r) : a; € A} 



and 



e>(V"(0)) + e 2 n \n(J e^dx) + e>(inf ^ n (x)) 

< ellnU ^(0)h €n (x)e ~Zr dx) 

< e>(V n (0)) +e>(/ e'^Tdx) + e>(sup/i £ „(x)). 



Therefore 



-e 2 ln( / ^(x)dx) + e 2 ln(V"(0)) ™^° inf{W(x) : x G A} = 0. 

The first term on the left goes to zero by Theorem 1. Thus so does the 
second, proving the claim. □ 

Lemma 4: lim W(x) = oo. 



Proof: Let K > 0, to be prescribed later and 5 < % for a, (3 as in 
9, c > 0, 77i i > 2, m 2 > 4. Define a C 2 function U en on M d satisfying: 



U e "(x) = e^T V ||x|| > K, 

= l VllzlK.K'-fr- 



C ^ 






\C en U £n (x)\ < .„ -. e^* V||x||<Ar. 
Then for llxll > if, 



C^U^tx) = SBWxW^e^t 



\P 



Ei=i a « , z 3 - ! 



T 9 L 3 A^ 



oil n ill m / > a ijXiXj 

2\\x\\ 2\\x\r *-^ 

I P II 11/3—3 \ v 1.1 \T "^ 

T" ~~ r I "i X / dijXiX j ~r 01 X) — ■ 

e„ \ 2 ^— ' \\x\ 

In view of (J2J), we may choose K large enough such that the r.h.s. above is 
< 0. Then by Proposition 2.3 of [Hj, / \C en U en \dfi en < oo and 



f f Of m 2 SK 

/ \L^U^W- < 2 / \e»ir*\df < TTTT^e^ 

JR d JBk(O) \? e n) 



Choose K\ > K such that 

\C €n U €n \ > e^T \/\\x\\>K x . 
Then 

i || re [1 2c rn 2 SK^ 

e~^~du €n < --—■ — e ^ , R > K x . 

B£(0) " (^ 2 ) mi 



Hence for R> K x , 



2m 9 SK l3 -SRl 3 



Op 2m 2 



T~ 



Let x G -Bjj(O) and B an open and bounded neighborhood thereof. Then 

-e>([inf^(x)]|6|) > -e>(/ ^(x)dx) 
* ee Jb r (o) 

> -e 2 M2c) + rmelHK) + V ~ m2<5 ^' 

leading to, in view of Lemma 3, 

8R 13 

sup W(x) > — m 2 5K 13 . 

e 2 

For i? large enough and B small enough, we have by the Lipschitz continuity 
of W that W(x) > ^-, which implies the result in view of our arbitrary 
choice of x. □ 

Lemma 5: VF(x) > for x ^ 0. 

Proof: Suppose W(x) = for some i^O. Considering x(0) = x in (1TB]) . 
we have 



1 ' T 



L2./o 



= H/(x) = inf - / M(t) T a(x(t))" 1 M(t)rft + W(x(T)) 



VT>0, 



implying that the infimum is in fact attained at u(-) = and the correspond- 
ing x(-) satisfies W(z(T)) = V T > 0. But in view of (JTBJ with «(•) = and 
our hypotheses on &(•), x(T) "f oo, leading to W / (x(T)) "| oo, a contradiction. 
The result follows. □ 

Thus we have: 



Lemma 6: W(x) = inf ^f^°u(t) T a 1 (x(t))u(t)dt where the infimum is 
over all (x(-),u(-)) satisfying ffT6l) with the additional restrictions: x(0) = x 
and x(t) ^ 0. 

Proof: We topologize the space of locally square-integrable u(-) as follows: 
For T > 0, let L 2 w [0,T} denote the space L 2 ([0,T]; R d ) with weak* topology. 
Equip the set of admissible u(-) with the coarsest topology that renders 
continuous the map «(•) — > w(-)I[o,t] £ ^[0^] f° r a U ^ > 0. Now consider 
the minimization problem of minimizing over u(-) G L^[0, T] the functional 



1 r T 



2-/o 



uitfaixity^uitfdt + W{x{T)), 



where x(-),u(-) are related through ffT6|) . with x(0) = x (say). Let 
W T = {ti£ L 2 w [0,T] I w(t) G T a.e.} 



It is easy to verify that (TT8T) is a lower semicontinuous functional which will 
attain its minimum over a compact set Ut of L^[0,T]. Let T' > T. Then a 
standard dynamic programming argument shows that 



u( 



eU T > => «(-)I[o,t] eW T . 



Define £/£ = the set of «(•) G W(= W^) such that «(-)|[o,ti £ Z^r- Then as 
T 7 oo, it is a family of nested decreasing compact subsets of U and therefore 
has a non-empty intersection. Take «*(•) in this intersection and let x*(-) 
denote the corresponding trajectory of (TT6J) . Then 

l r T 

W{x) = - / n*(t)a(x*(t))" 1 u*(t)rft + W{x*{T)) V T, 
2 Jo 

implying that W(x*(T)) | W* for some W* > 0. Suppose W* > 0. Then 
there exist < 5 < R such that 5 < x*(s) < R\f s. By Lemma 3.1 of |9J, we 
then have 



1 r 

W{x) > - / u*(t)o _1 (x*(t))«*(t)d< -> 

2 Jo 



oo, 



a contradiction. Hence VT* = 0. By Lemma 5, we have x*(T) — > 0. The 
rest is easy. □ 

Proof of Theorem 2: Immediate from the above lemmas. □ 

Let R e = e d e w / £ tp e . In [6 J it was shown that for a certain class of drifts, 
W is C l in an open, dense, connnected set G C M. d and 
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R t — > R uniformly on compact subset in G, 

where Ro satisfies the equation 

< b + aVW, VR > +(div(W) + | A W)R = (19) 

in G. The same result can be generalized for the class of drifts considered 
here, which subsume the drifts considered in [6] for (3 < 1. This is because 
the asymptotic stability of for ([3]) implies that the Jacobian matrix Db(0) 
will have eigenvalues with strictly negative real parts (see, e.g., section 1.3 of 
[15]). We state it as theorem below and omit the proof which is identical to 
that of Theorem 3 |6j. (Of course, the equation (fl9~|) gets suitably modified.) 

Theorem 3: There exists a positive function Rq e C 1 (G) such that R e — >• 
Ro- 

5 Extension to multiple equilibria 

Now consider the case when ([3]) has finitely many equilibria x%, ■ • ■ ,xj (say), 
and no other cu-limit sets. In this case, one can mimic the arguments of 
Theorem 1 to claim that all limit points of /i € as e l concentrate on the 
set {xi, ■ ■ ■ ,xj}. Furthermore, we again have W as the Lipschitz continuous 

subsequential limit of — e 2 ln(^4^yj as e j. 0, which satisfies (TTT|) . Also, by 

arguments of Lemma 4, we have limiMi-j-oo W(x) = oo. The proof of Lemma 
2 can be adapted to show that the limit points of /i e as e 4- will in fact 
concentrate on the set Argmin(W / (x) : x G {x±, ■ ■ ■ ,Xj}). 

Let (x(-),u(-)) denote an optimal pair with x(0) = x, as in Lemma 6. 
Then for t, T > 0, 

i r t+T 

W(x{t)) = - u(s) T a" 1 (x(s))u(s)ds + W{x(t + T)). (20) 

2 Jt 

Thus W(x(t)) is non- increasing with t, implying in particular that x(-) re- 
mains bounded. Thus f u(s) T a^ 1 (x(s))it(s)ds is bounded. By Banach- 
Alaoglu theorem, u{t + -)|[o,t]?^ > 0, is relatively compact in L^[0, T]. By a 
standard argument using Arzela-Ascoli theorem, one verifies that £(£ + ■) I [o,t] 
is also relatively compact in C([0, T]; M d ). Let (x*(-),u*(-)) denote a subse- 
quential limit of (x(t + -),u(t + ■)) mC([0,T];R d ) x L 2 w [0,T] as 1 1 oo. Then 
by the lower semicontinuity of the map 

u(-) e L™{0,T] -> f u(s) r a" 1 (x(s))M(s)cis, 
Jo 
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we have 

1 r T 

W(x*(0))>- u*(s) T a- 1 (x*(s))u*(s)ds + W(x*(T)). (21) 

2 Jo 

But W(x(t)) is monotonically decreasing by virtue of f l20|) . whence W(x*(0)) = 

W(x*(T)) = c = f \im ttoo W(x(t)). Thus u*(-) = a.e. We drop the 'a.e.' 
without loss of generality. It follows that x(t + •) converges as t t °° to 
H = r\ t> o{x(t + s), s > 0}, which is a positively invariant set of the o.d.e. 

x(t) = -b(x(t)). 

A similar argument can be given to establish negative invariance of this set 
as well, implying that it converges to an invariant set of the above o.d.e. But 
only such sets are the equilibria of flSJ). Since H is compact connected (being 
intersection of such), it must converge to a single equilibrium. Letting t = 
and T "f oo in (1201) , we then have 



W(x) = - M(t) T a- 1 (x(t))w(t)dt + W(xi) 
2 Jo 

for some 1 < i < J . Since we also have 

W{x) = inf \l I u{t) T a- x (x{t))u{t)dt + W{x{T)) 
L2 Jo 

it follows by a straightforward argument that: 

Theorem 4: 

rl f°° 
W(x)= mm mi - u(t) T a -\x(t))u(t)dt + W(x t ) . (22) 

1<1<J (x(-),u(-)):x(t)-+Xi VI J Q 



In particular, it follows that W attains its minimum at one or more of the 
ccj's. As W needs be specified only up to an additive factor, we may assume 
without loss of generality that its minimum value is zero. 

Note, however, that unlike in the single equilibrium case, the uniqueness 
of W, obtained as a subsequential limit, is not immediate. 

Theorem 5: W is uniquely specified as the Lipschitz function satisfying 
and the condition min W = 0. 
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Proof: Note that by (12"2"1) . we have by arguments similar to those used in 
Lemma 6 that for each x, there is an optimal pair (x* (■) , u* (■)) such that 
x*(t) — y Xi* for some i* that will depend on x, and 

1 f°° 

W(x) = - u*(t) T a-\x*(t))u*(t)dt + W{xi*). 

2 Jo 

If there is more than one i* for which this holds, we choose one according 
to some pre-specified rule. In this case, write x — y Xi*. We may also have 
Xi — y Xj for some i ^ j, with W(xj) <W(xi). In this case, write Xi =>- Xj. 
If we draw a directed graph with nodes {xi, • ■ ■ , Xj} with a directed edge from 
Xi to Xj whenever Xi =>■ Xj, we get a forest of rooted trees, say, T 1; • • ■ , T K . 

For each T±, let Xi denote its root. Let Oi = {x : x — y Xj for some Xj eTj}. 
Then M. d is the disjoint union of the Oj's. On each Oi, W is completely 
specified in terms of W{xi) by successive application of (122]) as follows: First 
use (1221) to obtain values of W at nodes {xj} in Tj one removed from Xi, then 
repeat the same for nodes two removed, and so on till W is defined for all 
nodes in Tj. Then define it for x G Oi by using f[2"2"j) again. In particular, 
iy is completely specified for those Tj for which W(xi) = 0. For others, it is 
in principle specified up to an additive scalar, because the value of W(xi) is 
not specified. But we have the additional restriction that W be continuous 
(in fact, Lipschitz) over the whole of lR d , whence this choice is also unique. 

Uniqueness of W as lim^o ( — e2m (v 9<E (')) ) follows. □ 

Remark: The problem of finding stationary density is one of finding the 
principal eigenfunction of an operator. A counterpart of the above in this 
general framework, albeit in a discrete set-up, appears in 



References 

[1] ARISAWA, M. (1997) "Ergodic problem for the Hamilton- Jacobi- 
Bellman equation. I. Existence of the ergodic attractor", Ann. Inst. 
Henri Poincare 14, 415-438. 

[2] ARISAWA, M. (1998) "Ergodic problem for the Hamilton- Jacobi- 
Bellman equation. II", Ann. Inst. Henri Poincare 15, 1-24. 

[3] CRANDALL, M. G.; LIONS, P. L. (1983) "Viscosity solutions of 
Hamilton- Jacobi equations" , Trans. American Math. Soc. 277, 1-38. 



13 



[4] CRANDALL, M. G.; LIONS, P. L. (1987) "Remarks on the existence 
and uniqueness of unbounded viscosity solutions of Hamilton- Jacobi 
equations", Illinois J. Mathematics 31, 665-688. 

[5] DAY, M. V.; DARDEN, A. T. (1985) "Some regularity results on the 
Ventcell-Freidlin quasi-potential function", Appl. Math. Optim. 13, 259- 

282. 

[6] DAY, M. V. (1987), "Recent progress on the small parameter exit prom- 
lem", Stochastics 20, 121-150. 

[7] ECKMANN, J. P.; RUELLE, D. (1985) "Ergodic theory of chaos and 
strange attractors", Reviews of Modern Physics 57, 617-656. 

[8] ETHIER, S. E.; KURTZ, T. G. (1986) Markov Processes: Characteri- 
zation and Convergence, John Wiley, New York. 

[9] FLEMING, W. H. (1978) "Exit probabilities and optimal stochastic 
control" , Appl. Math. Optim. 4, 329-346. 

[10] FOSTER, D.; YOUNG, H. P. (1990), "Stochastic evolutionary game 
dynamics", Theoretical Population Biology 38, 219-232. 

[11] FREIDLIN, M. L; WENTZELL, A. D. (1998) "Random Perturbations 
of Dynamical Systems" , Springer Verlag, New York. 

[12] FRIEDMAN, A. (1987) "Stochastic Differential Equations", Vol 2, Aca- 
demic Press, New York. 

[13] GIHMAN, I. L; SKOROKHOD, A. V. (1972) Stochastic Differential 
Equations, Spriinger Verlag, New York. 

[14] GILBARG, D.; TRUDINGER, N. S. (1977) "Elliptic Partial differentail 
equation of second order", Springer- Verlag, Berlin. 

[15] GUCKENHEIMER, J.; HOLMES, P. (1983) Nonlinear Oscillations, 
DDynamical Systems, and Bifurcations of Vector Fields, Springer Ver- 
lag, New York. 

[16] KHASMINSKII, R. Z. (1960) "Ergodic properties of recurrent diffusion 
processes and stabilization of the soluution to the Cauchy problrm of 
parabolic equations", Theory of Probability and Appl. 2, 179-196. 

[17] KHASMINSKII, R. Z. (1980) Stochastic Stability of Differential Equa- 
tions, Sijthoff and Noordhoff, Leyden, The Netherlands. 

14 



[18] METAFUNE, G.; PALLARA, D.; RHANDI, A. (2005) "Global proper- 
ties of invariant measures" , J. Functional Analysis 223, 396-424. 

[19] MIKAMI, T. "Asymptotic expansions for the invariant density of a 
Markov process with a small parameter", Ann. Inst. Henri Poincare 
24, 403-424. 

[20] SASTRY, S. S. (1983) "The effects of small noise on implicitly defined 
nonlinear dynamical systems", IEEE Trans, on Circuits and Systems 
CAS-30, 651-663. 

[21] SHEU, S.-J. (1986) "Asymptotic behavior of the invariant density of a 
diffusion Markov process with small diffusion" , SIAM J. Math. Analysis 
17, 451-460. 

[22] SHEU, S.-J.; AND WENTZELL, A. D. (1999) "On the solutions of 
the equation arising from the singular limit of some eigen problems" , in 
^ Stochastic Analysis, Control, Optimization and Applications' (W. M. 
McEneaney, G. George Yin, Q. Zhang, eds.) Birkhauser, Boston, 135- 
150. 

[23] STETTNER, L. (1989) "Large deviations of invariant measures for de- 
generate diffusions", Probability and Mathematical Statistics 10, 93-105. 

[24] YOSIDA, K. (1980) Functional Analysis (6th ed.), Springer Verlag, 
Berlin-Heidelberg. 



15 



o 



(N 






> 



Erratum for 'Small noise asymptotics for 

invariant densities for a class of diffusions: a 

control theoretic view' 

Anup Biswas* Vivek S. Borkart 



The uniqueness argument in the proof of Theorem 5, p. 483, of [T] is 
flawed. We give here a corrected proof. 

Define 

cT 



Sot(<P) = \f (fa) - 6(0( S )))a- 1 (^( S ))(<A - b(cj>(s)))d S . 



and 

Vi(x) = mt{S OT (0) : 0(0) = x h 0(T) = x], 

where the quantities are defined for absolutely continuous paths. 

Lemma 0.1 Under the stated assumption in Fj]/ ; Vi(x) —> oo as \\x\\ — > oo 



t^~- ' for i < i < J. 

t> ' 

Proof. Consider the stochastic differential equation 
(N 

t> ; dY € (t) = b{Y e (t))dt + edB(t), 

where B{-) is a d-dimensional Brownian motion. Then following the argu- 
ments in [Ij, page 477-479, we have a Lipschitz continuous viscosity solution 
[/(•) to the p.d.e. 

X 

5h 1 

min[(-6(z) - u).VU + -\\u\\ 2 } = 0. 



2 
Also arguing as in Lemma 2, [TJ we have U(-) > 0. As in [lj, we define 

U(x,t)= inf [\ I \\u{s)\\ 2 ds + U{x(t))l 
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where the infimum is taken over all locally square integrable u(-) satisfying 
x(s) = —b(x(s)) — u(s), x(0) = x. One can easily check that U(x,t) is 
continuous on M x [0,T] and Lipschitz in space variable uniformly w.r.t. 
t G [0,T]. Also U(x,t) is a viscosity solution to the equation 

U t (x,t) = min[(-6(x) - u).S/U + -\\u\\ 2 ]. 



Therefore applying Theorem VII. 2. in [2] (see also the Appendix) we have 
U(x)= inf if \Hs)\\ 2 ds + U(x(T))}, (0.1) 

x(0)=x I Jo 

where the infimum is over all (x(-),u(-)) satisfying 

x(t) = -b(x(t)) - u(t), x(0) = x 

with u(-) locally square integrable. Furthermore, applying Lemma 4 in pQ 
we have U(x) — > oo as ||x|| — > oo. Suppose there exists a sequence {y n } 
such that \\y n \\ t °° an d Vi(Vn) < M for all n > 1 and some < M < oo. 
Therefore there exists {4>n(')} such that 

SoT n (4>n) < M + 1, n (O) = Xj, (/>„(T n ) = y n . 

Define ip n (s) = (j) n {T n — s) for s <T n and 

u f s ) = / ~^( s ) ~ Ki'n(s)) for s < T n 
\ otherwise. 

Therefore ip n {s) = —b{ip n {s)) — u{s). Hence from (jU.ip we have 

1 /' Tn 
U{y n ) < - / ||n n (s)|| 2 ds + C/(^) 
1 Jo 

= ASotM + U(xi) < A(M + 1) + U(xi), 

where A is the maximal eigenvalue of a(-). This contradicts the fact that 
U(x) — > oo as ||x|| — > oo. This proves the claim. D 

Since there are only finitely many equilibria, it is easy to see that V(x) := 
mhii<j<j Vi(x) — > oo as ||x|| — > oo. We introduce the following notations: 

V(xi, Xj )=mi{Sur(<l>) : 0(0) =Xi,<f>(T) = x j ,c/)(s) el^U^fe}}. 

Let Br denotes the ball of radius R around 0. For R large, define 

V R (xi,Xj) = inf{5 r(<A) : 0(0) = Xi,cp(T) = x j} 

^)G^\U ¥l ,K}Vse[0,T]}. 



Let pi,po be such that < p\ < po < mini<ij<j \\x{ — Xj\\. Let Ti,gi denote 
the boundaries of the balls of radius po,pi respectively around Xj. Denote 
r = Ui<j<jrj and g = \Ji<i<jgi. Define r = 0, a n = inf{£ > T n : X e (t) G 
L},T n = min{£ > <t„_i : X e (t) G g}, where -X" e (-) satisfies the stochastic 
differential equation (1) in [I], i.e., 

dX e (t) = b{X e {t))alt + ea{X e (t))alB{t). 

Define the Markov chain Z n := A^t,,,). 

Lemma 0.2 For any 7 > there exists po small such that for any p%,0 < 
Pi < Po, there exists p\,0 < p\ < P2, such that for e sufficiently small, for 
all x G gi the one-step transition probabilities of Z n satisfy the inequalities 

( V(xi,Xj) + -f \ ( V(xi,Xj) -j \ 
ex P I ^2 I - P \ x >9j) < ex P I -^ I • 

Proof. We choose R > large enough such that following holds: 

• Any solution of x(t) = b(x(t)) that starts in Br, stays in Br, 

• V R (xi,Xj) - 2 < V(xi,Xj) < V R (xi,Xj) for all 1 < i, j < J, 

• mm x& QB R V(x) > V(xi,Xj) + 47 for all 1 < i, j < J. 
Therefore applying Lemma 6.2.1 in [3 J we have for x G gi, 

P / w ( Vr{xj,x j )+ 1 /2 \ ( V{x l ,x j ) + 1 \ 
P{x,gj) > exp I -| I > exp I -^ I 

for e small. To get the upper bound we follow the calculations in (|3j, page 
174). Following the calculations on page 174 (estimate (2.6)) of [3] it is 

enough to bound P x {t\ > T) by exp ( J 2 ) f° r a chosen T > 

and x G T,. At this point we define £ = min{£ > : X e (t) G 8Br}. Let 
Vq = min xl =QB R V(x). Now for x G Tj 

P x (ri >T)< P x ( n >T,£>T) + P x (£ < T). 

Using Lemma 6.1.9 in [3], we can choose T large such that sup xgr . P x {t\ > 
T,£ > T) < exp (— ^t) for e small enough. We fix this choice of T. To 
estimate the other term we define <J>(x) = {(ft : SoH^) < Vo — 7/4} for 
x G Tj. Now any path starting at x that leaves Br by time T must be at 
least 77 distance away in C([0, T],R ) from <£(x) for poi 7 ? small and x G Tj. 
Therefore using the Freidlin-Wentzell large deviations principle we have (see 
also [3], page 174) 

sup P X (C <T)< sup P x (distort, $(x)) > rj) < exp f V o~V 2 

x€Ti x&Vi V e 



for e small where distor(0i> 02 ) = su P[o,r] Il0i( s ) ~~ 02(s)|| is the uniform 
metric on C([0, T],R ). This completes the proof. □ 

Taking V = ||x|| 2 , for e small we have from [1] (estimate (4) of |lj) 

C e V < -5 2 , \\x\\ > K. (0.2) 

for some positive 82 ■ Let D\ = Bk and D = Bk+i- We need to estimate 
the hitting time r = min{£ : X e {t) & Uidgi}. Let Oi denote the closed ball 
of radius p\ around Xi. 



Lemma 0.3 Let K = D\ \ UOj. Then there exists M\ > such that 



sup E x [t] < Mi 



for all e € (0, eo). 



Proof. Define r = mm{t : X € (t) £ D \ UjOj}, a t = mm{t > Tj_i : X e (t) G 
dDi}, Ti = mm{t > o~i : X e (t) £ D \ UjOj}. Using (|U.2|) we can show that 

V(x) 

SUp ^a;[0"l] < SUp — = M2. 

x&dD xedD 8 2 

Also, Lemma 1.9, pp. 168, of [3J shows that 

sup E x [r ] <M 3 , 

K 

for e > small. If for some i, X e {ri) € Uidgi then we define <Tj + i = Tj + i = 
• • • = Ti. By positive recurrence we know that P(t < 00) = 1. Hence for 

xeK 

00 

E x [t] = E x [Y^Til {T=n>T>n _ l} ] 

i=0 

oo i 

= ^E E^ ~ r fe-l) I {r=r,,r>r l _ 1 }] [with T-\ = 0] 
i=0 fc=0 

oo oo 

= ^E E^ Tfc ~ 7 *-l) I {T=T <) r>7i_i}] 
fc=0 i=k 
oo 

= E x Q2(r k ~ r fc _i)I {r>Tfc _ l} ] 

k=0 

oo 

< sup£ x [r ] + E x [Y](T k - T fc _l)I/ r>T }] 

oo 
= M 3 + Y, E*[(n - Tk-l)K { r>T k _ l} } 

k=l 

oo 

< M 3 + sup E x [tx] Y, P{t > r k - 






For x e dD we observe that -E x [ti] = E x [t\ — a\ + a{\ < M3 + M^. Also 
for k = 1, sup X £kP(t > to) < S for some 5 < 1/2 and e > small. 
(This is because then the probability concentrates around the deterministic 
trajectories of the o.d.e. for e = 0, which always hit Uidgi before hitting 
dD.) So for k > 2, 

P(t > T k -l) < P(t > cr fe _i) sup P x {t > To) 

xedD 1 

< 5P(T>T k _ 2 ) 

< 8 k ~ x . 

Hence combining with the above calculations we have sup^gjj E x [t] < Mi < 
00 for all e G (0, eo)- □ 

Let G(i) denote the set of all i-graphs defined on page 177 in [3]. Define 
Z(xi) = min J~] V(x m ,x n ). 

(rrn-n)Gx 

Recall that [i e is the inavariant measure of X e {-). Proof of the following 
theorem is same as the proof of Theorem 6.4.1 in [3j 

Theorem 0.1 For any 7 > there exists p± > (can be chosen arbitrary 
small) such that the // -measure of Xi + B pi is between 

f Z(xi) — min, Z(xj) ± 7 
exp I -^ 

for e sufficiently small. 

Now we are ready to prove Theorem 5 in [lj. 

Theorem 0.2 The function W(-) obtained in Theorem 4 of fjjj is unique 
and given by 

1 f°° 
W(x t )=mm inf [- / u(tf a~ l (x(t))u(t)dt + W { Xi % 

l<i<J (x(-),u(-)):x(t)-+xi Z Jo 

where (x(-),n(-)) satisfies (16) in IJjj. 

Proof. The above expression implies that W(-) is uniquely determined by 
the values W(xi),l < i < J. Recall that there exists a subsequence {e n } 
such that — e 2 n ln(ip €n (x)) — > W(x) uniformly on compact subsets of M. d as 
e n — > where ^ e (') denotes the invariant density of \x e . To prove the 
uniqueness it is enough to show that the values of W(xt), 1 < i I < J, are 
uniquely determined. Let 7 > be small. Choose p\ small enough so that 



|W(cc) — PF(xi)| < 7 for all \\x — X{\\ < p\. Therefore applying Theorem lO.il 
we have 

-e^ln[ sup ip en \B pi (xi)\] < Z{xi) - minZ(xj) + 7, 

for n large enough, where |^4| denotes the Lebesgue measure of A. Therefore 
letting n->oowe have 



inf W(x) < Z(xi) — minZ(xj) + 7, 
and hence 



B pi(*i) 



W{xi) < Z{xi) - miiiZ(x,-) + 2 7 . 
3 

Similarly using the upper bound in Theorem 10.11 we have 

W{xi) > Z{ Xi ) - minZ(x i ) - 2 7 . 
3 

Since 7 > is arbitrary, we have W{xj) = Z{xi) — minj Z(xj). This com- 
pletes the proof of the theorem. □. 

Other minor corrections 

• The closed bounded set T in the expression (15), page 479 in [I], should 
be taken as a closed bounded ball with center at the origin. 

• We need to assume that -g-^(0) = 0, for all i,j, in Theorem 3 in [T]. 
Appendix 

Here we prove uniqueness of viscosity solution of the Hamilton Jacobi 
equation 

u t + H(x,Du) = in R d x (0, T] (0.3) 

u(x,0) = g{x). 

We prove the uniqueness along the lines of [2]. We assume the following 

(Al) For some local modulus a : [0, 00) x [0, 00) — > [0, 00) 

H(y,\(x-y)) -H(x,X(x - y)) < a(X\\x - y\\ 2 + \\x-y\\,R) 

for R > 0, x, y € B R , A > 0. 

(A2) There exists a constant Cq > such that 

\H(x,p) - H(x,q)\ < C (l + ||p|| + ||g||)||p - q\\ 

for all x,p,q € M. d . 

6 



Let u, v be two viscocity solution of (|0.3p which are continuous on R" x [0, T] 
and Lipschitz in space variable uniformly w.r.t. t € [0,T]. To show that 
u = v on M x [0, T] it is enough to show that 

sup (u — v) + < 0. 

M d x[0,T] 

Now if possible, let there exists x > such that for some to > 0, xq € M d , 

u(x ,t ) -v(x ,t ) > 3x- 

Let 

\u(x,t) — u(y,t)\ < K\\x — y\\ and |u(x, t) — v(y,t)\ < K\\x — y\\ 

for all t £ [0, T]. Therefore from assumption (A2) we have 

\H(x,p)-H(x,q)\<C\\p-q\\ (0.4) 

for p € D+u(x,t), q G D~v(y,s) for all x,y € M d and s,£ £ (Oj^l- For 
< 6 < 1, define 

u;*(x,t) = exp | ^(log(l + ||x|| 2 ) + -^q 1 ~ R 
It is easy to check that 

—±-C—\\Dw 5 \\ >0inIR d x (0,oo). 

Choose R large enough so that log(l + ||x || 2 ) + x?e i o~ 6 ' - -R < 0. Now 
define Qr = {5\ogw$(x,t) < 1} C M. d x [0, T]. It is easy to see that there 
exists a compact set IK independent of 5 such that Qr C IK x [0, T] for all 
5 > 0. Let M = (maxQ fl u(x, t) V maxg fl v(x, £)). Now we choose S small so 
that ws(xa,to) < (x A 1) and e^ > 2M. On Q# x Q#, define 

M 1 1 9 I 1 9 

<£ — y -f t — s\ 

$(x, i, y, s) = u(x, t) - v(y, s) - w$(x, t) a(t + s) 

e 

for a, e > 0. For a > small, we have 

sup $ > 9(x , t ,x ,t ) > x > 0. 

Let (x,t,y,s) be the point where the maximum of <3? is attended. By stan- 
dard calculations, it can be shown that 



x-yf + \i-s\* <2 M. 



• H g ~ g|13 ->■ as e -> 0. 

e 

Using the uniform continuity of u, u, u^ on Q/j and by our choice of 5 it is 
easy to show that t > 0, s > for e > small. Also for the same reasons, 
5 log w$(x,t) < 1 and 5 log ws(y,s) < 1. Hence we can apply the definition 
of viscosity solution to the points (x,t), (y, s) to get 

dws(x,t) A — s „_ / _ , ^ „x — y\ 

a + — ^^ + 2 +H[x, Dw s (x, t) + 2 y - < 0, 

at e \ e / 

and 

-a + 2— — +Hly,2— ^-\ > 0. 

Subtracting we have 

2a + ^^ + ^(x,^(x,t) + 2^)-^(x,2^) 

+^(x,2^)-i7(y,2^)<0 

Therefore using (|U,4|) we have 

2a+ ^ 7 -y|J«ii(i,t)||g i,2- -gj -ffk2— ^J <0 

Now letting e — > and using (Al) we have 2a < which is a contradiction. 
This proves the uniqueness claim. 
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